Method for providing real-time service of huge and high quality digital image on internet

ABSTRACT

A method for providing real time service of huge and high quality digital image on internet is disclosed, wherein data relevant to a general life such as a general photo, an advertising leaflet, and a pamphlet and professional image data exhibited in an art gallery, exhibition grounds, a pavilion are made into huge and high quality digital image or scanned and photographed to be digital, thereby processing real time service as an interactive browsing form. In the present invention, data are directly made, edited, constructed, and uploaded on internet, thereby providing various additional information with image through hyperlink and processing high quality digital image service on network without speed delay for huge image.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation Application of prior U.S. patentapplication Ser. No. 15/496,366 filed Apr. 25, 2017, which is aContinuation Application of prior U.S. patent application Ser. No.14/984,764 filed Dec. 30, 2015 (now U.S. Pat. No. 9,674,555), which is aContinuation Application of prior U.S. patent application Ser. No.14/333,813 filed Jul. 17, 2014, which is a Continuation Application ofprior U.S. patent application Ser. No. 13/933,909 filed Jul. 2, 2013,which is a Continuation Application of prior U.S. patent applicationSer. No. 13/230,989 filed Sep. 23, 2011 (now U.S. Pat. No. 8,503,829),which is a Continuation Application of prior U.S. patent applicationSer. No. 12/613,818 filed Nov. 6, 2009 (now U.S. Pat. No. 8,036,496issued Oct. 11, 2011), which is a Continuation Application of prior U.S.patent application Ser. No. 11/713,813 filed Mar. 5, 2007 (now U.S. Pat.No. 7,634,144 B2 issued Dec. 15, 2009), which is a ContinuationApplication of prior U.S. patent application Ser. No. 10/345,432 filedJan. 14, 2003 (now U.S. Pat. No. 7,209,602 B2 issued Apr. 24, 2007),which claims priority under 35 U.S.C. § 119 to Korean Application No.30804/2002 filed on May 31, 2002, whose entire disclosure is herebyincorporated by reference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a service of high quality digital imagethrough internet, and particularly, to a method for providing variousinformation through interactive user interface, wherein image data andeach kind of professional data commonly used in daily life are providedto enhance utilization of image data.

2. Description of the Background Art

In the related art, since data such as an advertising leaflet, apropaganda is booklet, a handbill, a pamphlet, and etc. are almost usedfor one time, advertisement and publicity effect is not great and thedata did not last for a long time. Also, professional data include eachkind of works of art, photo works exhibited in an art gallery and apavilion. The data provide simple information and there was aninconvenience to visit an art gallery or a pavilion to appreciate thecorresponding works.

In the related art, even if an art gallery or gallery service areprovided through internet and various internet-album services areperformed, enormous image corresponding to hundreds of sheets or tenthousands of sheets and enormous image corresponding to scores of MB orhundreds of MB were not processed in a constant network bandwidth,thereby limiting quality and size of service image. That caused imagequality to be degraded and made it almost impossible to provideadditional information (moving image, sound, and etc.) with image. Thatis resulted from that a limitation about a method for providing hugeimage real time through network is not overcame. Also, since imageinformation is downloaded and then displayed on a screen, it wasimpossible for users to appreciate high quality works real time.

SUMMARY OF THE INVENTION

Therefore, an object of the present invention is to provide a method forutilizing high quality image as a synthetic medium, wherein generalimage data such as a photo, an advertising leaflet, a handbill, apropaganda booklet, a pamphlet, and etc. and professional image datasuch as art works and professional photo works are digitally made intohuge and high quality, thereby providing the contents into high qualityimage through wire and wireless network and connecting the contents withrelevant additional information.

To achieve these and other advantages and in accordance with the purposeof the present invention, as embodied and broadly described herein,there is provided a method for providing real time service of huge andhigh quality digital image on internet, wherein a server system forcommunicating with a plurality of client systems on internet andproviding information by a request of the client system, comprises ahigh quality image conversion system for converting digital image intohigh quality image data format; an editing system for editing andreconstructing the converted data; and a database for storing the editeddata, the system comprising the steps of editing and reconstructing theconverted data; storing the edited data; and transmitting the storeddata to the client system on internet at the time of request by theclient system.

The foregoing and other objects, features, aspects and advantages of thepresent invention will become more apparent from the following detaileddescription of the present invention when taken in conjunction with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this specification, illustrate embodiments of the invention andtogether with the description serve to explain the principles of theinvention.

In the drawings:

FIG. 1 is a pattern diagram showing layered data;

FIG. 2 is a pattern diagram showing a process in which huge image isdivided and transmitted.

FIG. 3 is a flow chart showing an overall process of a system for highquality digital image internet service according to the presentinvention;

FIG. 4a is a pattern diagram showing graphic user interface (GUI) ofhigh quality image edit program;

FIG. 4b is a pattern diagram showing GUI of a menu region of highquality image edit program;

FIG. 4c is a pattern diagram showing GUI of a working region of highquality image edit program;

FIG. 5 is a pattern diagram showing one embodiment of GUI of highquality digital image service according to the present invention;

FIG. 6a is a screen capture showing one embodiment of GUI of a cybergallery according to the present invention;

FIG. 6b is a screen capture showing one embodiment of zoomed-in GUI of acyber gallery according to the present invention;

FIG. 7a is a screen capture showing one embodiment of GUI in which auser transmits a photo to a server in an internet album according to thepresent invention;

FIG. 7b is a screen capture showing one embodiment of GUI showingcompleted album lists in an internet album according to the presentinvention;

FIG. 7c is a screen capture showing one embodiment of GUI of an internetalbum according to the present invention; and

FIG. 7d is a screen capture showing one embodiment of zoomed-in GUI ofan internet album according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Reference will now be made in detail to the preferred embodiments of thepresent invention, examples of which are illustrated in the accompanyingdrawings.

In a method for providing real time service of huge and high qualitydigital image on network, are processed small images transformed to besuitable to a main memory unit of a general personal computer.Accordingly, any huge image can be displayed in a user computer realtime, and hyperlink such as another huge image, animation, and othermedia files can be provided with the huge image.

To this end, a new client/server model for transmitting huge image oninternet is installed.

Characteristics of the present invention are as followings.

First, image encoding based on partial access.

Second, temporal storage (caching) of image information corresponding toa display screen in a client system where image information istransmitted and removal of unnecessary image.

Third, intellectual queuing and pipelining of a server which providesimage information.

Image Encoding

Partial access divides very huge image into small sub cells, andconverts into layered data having multiple zoom levels. That is, in thepresent invention, sub cells converted into high quality image data aretransmitted instead of transmitting an overall huge image, therebyimproving image-processing speed. Since users do not look an entire hugeimage by high resolution, only sub cells displayed on a screen aretransmitted from database and displayed in the client system.Accordingly, amount of unnecessary data transmitted through network islargely reduced, thereby fast transmitting and displaying. Imagedivision and layered data generation in the partial access will be laterdescribed.

Client System

If a user is connected to a server through internet, a clientapplication is automatically transmitted from a server system to aclient system. The application tracks a user's input contents anddetermines a position of a view pointer of which movement is determinedon a screen by moving a mouse. According to that, necessarycorresponding sub cells are all transmitted from the server anddisplayed. To minimize a loading on network, the client systemtemporarily stores sub cells around the view pointer. When a usersearches image around the view pointer, relevant sub cells already existin a memory. Therefore, a request for additionally transmitting imagefile is not needed.

If a user moves the view pointer, the client application requests subcells regarding to a new image to the server. In the process, time delaycan be generated at the time of transmitting data on network andprocessing in the server. However, if a user moves the view pointer andrequests a new image, sub cells regarding to previous image are notneeded any longer. The client application can additionally request theserver to delete the sub cells, and by the request, load on network canbe reduced.

Server System

Queue is a data structure in computer programming for removing dataaccording to input orders. According to an intellectual queuing in thepresent invention, input and display are minimized in dealing with imagerequest from numerous clients. For example, if a client A requests subcells 1, 2, 3 and 4 and a client B requests 3, 4, 5 and 6, a queuinglayer receives the sub cells 1, 2, 3, 4, 5 and 6 as one order withoutoverlapping the sub cells 3 and 4. Accordingly, if numerous clientssimultaneously request overlapped information, processing amount in theserver is reduced, thereby processing fast.

In the meantime, the server system asynchronously processes numerousrequests from the client by using pipelining. Generally, if usersrequest to the server, they wait a response from the server for a while.If the server can not perform one request, a series of requests from theclient are interrupted. In the present invention, a client cansimultaneously transmit numerous requests to a server throughpipelining.

A pipeline means that movement of command words towards a processor oran arithmetical step by the processor to perform the command words areconsecutive and overlapped. If a pipeline does not exist, a processor incomputer takes first command words from a memory, performs a calculationrequested by the command words, then takes next command words from thememory. While taking the command words, an arithmetical calculation partof the processor has to rest with waiting for next command words toarrive.

If the pipeline is used, it is possible to take next command words whilethe processor performs an arithmetical calculation and bring the wordsto a buffer around the processor until next command words are performed.A step for bringing command words is continuously repeated. As a result,a number of command words performed in a set time is increased.

In the present invention, the server allocates a special address foreach request transmitted from numerous clients, and immediatelytransmits a response to the client as soon as the request is performed.At this time, the transmitting order needs not to be equal to an orderwhich the server receives a request. By the pipelining, the server canrespond to the client system faster than a user's expectation.

Image Encoding

In the present invention, digital information including huge imageinformation is converted into high quality digital image data on thebasis of partial access by the following processes.

(1) converting huge image into multiple layered data with levels

(2) dividing the huge image into numerous sub cells

(3) compressing the images into divided cell units

To convert into high quality image data, general image files such asBMP, GIF, PNG, JPG, etc. are used as original text contents. Also, someadvertisement data made by PDF are converted into image file for use.

Layered Data Generation

In the present invention, image data having a layered structure aregenerated so as to provide high quality image in which images ofmultimedia digital publication and etc. transmitted real time on networkare magnified or contracted fast and accurately according to levels.That is, a plurality of data layers converted with ½″, . . . , ¼, ½, 1times, etc. of an original image are generated.

FIG. 1 is a pattern diagram showing layered data with magnification orcontraction levels. As shown in FIG. 1, high quality individual imagesare constituted by layers according to displayed levels at the time ofmagnification or contraction, and respective layers 70, 80, and 90 areused in magnification or contraction steps. That is, in case ofmagnifying, images are displayed from upper data 70 to bottom data 90via middle data 80. On the contrary, in case of contracting, images aredisplayed in reverse order. Also, it is possible to change the displayedscreen discontinuously.

A number of layers in the layered structure are determined by graphicuser interface (GUI). In FIG. 1, data layers of three steps areillustrated, but if graphic user interface can provide a function ofmagnification or contraction with four steps, image data are convertedto have four layers.

Division of Huge Image

The generated data layers are divided into a plurality of sub cells. Bydividing the data, huge image is fast transmitted. Division units of thehuge image into a plurality of sub cells are determined by a processingability of a client system and a transmittance speed on network. At thistime, a number of sub cells are determined within an optimum scope.Indexes are endowed to each cell of the divided images, and the imagesare integrated by positions or orders. The integrated cells exist as onefile, but only corresponding cells of the huge image are transmitted bya client's request. According to this, a client can fast see his wantedimage.

Referring to FIG. 2, a process for displaying the divided image datareal time on network will be explained. Individual image data 110 and120 stored in database consist of sub cells respectively. In Figure, Eijand Fij represent sub cells of i line and j column.

As aforementioned, dividing image data into each sub cell unit and thenstoring is determined by a processing ability of a client system and atransmittance speed on network. At this time, if a large number of subcells are divided, a processing speed in a central processing unit of aclient system is down, and if few sub cells are divided, a transmittancespeed on network is down. Therefore, it is important to divide the subcells within an optimum scope.

For example, supposing that screen display resolution is 1024.times.768pixel, images displayed on a screen—are divided into 5 horizontal subcells and 4 vertical sub cells. The cells divided at an optimumcondition prevent delay in a transmitting process or in a displayprocess, and transmit image fast.

The divided sub cells are compressed, and endowed with indexes, so thatpositions and coordinates etc. in an overall image are recorded. Then,the sub cells are integrated into one file and stored in database.

High quality image data according to the present invention are stored asa compressed form so as to improve a transmittance speed.

It is preferable to compress data into each divided sub cell unit. Atthis time, compression technique such as widely known JPEG, GIFE areused. Each sub cell can be compressed with a same method independently,or compressed with different methods. For example, in case of datahaving a figure and a picture together, GIF compression is used at thefigure and JPEG compression is used at the picture. By doing so, it ispossible to improve compression efficiency of an image.

The compressed sub cells are integrated according to orders andpositions, and are endowed with indexes respectively, then stored indatabase. The indexes can include not only base information of sub cellsbut also additional information relevant to the sub cells. A serversystem is connected to the indexes and selects sub cells of a wantedimage, thereby fast transmitting.

Hereinafter, the present invention will be explained in detail withreference to preferred embodiments.

FIG. 3 is a flow chart showing an overall process of a system for highquality digital image internet service according to the presentinvention. First of all, contents are collected from an advertiser, apainter, a photographer, or individual users (160). In thecontents-collecting step, additional information regarding to eachcontent, for example, moving image file, sound file, text explanationdata, etc. are together included. The collected contents are convertedinto image files, or scanned to be converted into digital information,thereby being made into high quality image data according to the presentinvention (170). The high quality image data can be edited in atemporarily stored state (180). High quality image data having completededition are respectively stored in image database and additionalinformation database (190), and transmitted from the server to theclient system through internet by a client's request. The process willbe explained as follows.

All kinds of contents off line, for example, a general photo, anadvertising leaflet, a propaganda booklet, a pamphlet, a work of art,and etc. are scanned or converted into a digital photo, thereby beingmade into high quality digital image data. High quality data can beconstituted with index data including additional information (movingimage, sound, flash animation, and web page, etc.) or individuallyextracted keywords necessary to search.

The completed high quality digital image can be individually stored orstored by reconstructing the relevant contents as one package form. Inthe case, a separate program for edition can be used. Details for thatwill be later explained.

The server system transmits corresponding image regions (sub cellscorresponding to parts requested by users) according to users' requeststhrough internet by a program (client application) for real time servingthe converted contents into high quality image data. In the clientsystem, contents can be real time browsed by a browser such as internetexplorer, and etc.

A method for a user to generate high quality image data according to thepresent invention includes a download method and a method using a serverprogram.

In the download method, high quality image conversion program isdownloaded to be installed in a user's computer system, then, generalimage data are converted into high quality image, thereby uploading toan internet server. In the method using a server program, a user uploadsa general image to the server, then directly makes high quality image oninternet by using programs installed to the server. In the presentinvention, a user and a server are interactive by communicating eachother, thereby more satisfying a user's request and maximizing a serviceeffect by a user's participation.

The high quality image data made in the above process are stored in atemporal storage unit of the server.

A method of the present invention includes an editing process fordirectly constituting a gallery or an internet album site by using highquality image data besides a making process for making high qualityimage data by a user. The temporarily stored high quality image passesan editing process shown in FIG. 4a or 4 c.

FIG. 4a is a pattern diagram showing one embodiment of GUI of highquality image editing program. The editing program consists of a menuregion 210, a working region 220, and a tool-collecting region 230. FIG.4b shows one embodiment of the menu region 210. The menu region includesmenus such as canvas, edition, panel, view, help, and etc., or caninclude sub menus according to each function.

The working region 220 is a space where high quality image is brought toperform various workings.

In the tool-collecting region 230, shortened icons of frequently usedmenus and special menus are made, thereby making the working convenient.

A user can store image data as individual image by using an editingprogram, or can store as a canvas unit by constituting the necessaryimage data as one package form. Also, it is possible to add a panel toeach high quality image data, and to connect multimedia additionalinformation such as moving image, sound, flash, and etc. with a text. Incase of storing image data as a canvas unit, as shown in FIG. 4c ,several high quality images 260 a and 260 b are brought in one canvas(working region) 250, then a user sets and changes size, color,multimedia additional information, text, position, and etc.

High quality image or canvas completed by using the editing program arestored in a separate database.

Since the editing program is performed in a server, a user is connectedto the server to use the editing program and then the completed highquality image lo or canvas are stored in a separate database.

FIG. 5 is a pattern diagram showing a user interface for displaying highquality image display. The user interface consists of a function buttonregion 310, a section menu and searching region 320, and an imagedisplay region 330.

The function button region 310 includes a tool for selecting contentsaccording to kinds, a tool for selecting a part of displayed image, atool for displaying the selected region, and a scrap function forstoring the selected region or individual images as another file.

In the section menu and searching region 320, contents aresub-classified by constructions, and corresponding image information isincluded. The searching region consists of a part for inputting asearching keyword and a part for showing a searching result. Thesearching result is shown at a bottom of the section menu as a listform.

In the image display region 330, selected images are displayed. GUIshown in FIGS. 4a and 5 is only one embodiment, and other transformedGUI will possibly be provided.

FIGS. 6a and 6b are preferred embodiments according to the presentinvention showing a digital gallery to which a method of the presentinvention is applied.

In the meantime, FIGS. 7a and 7b are preferred embodiments according tothe present invention showing a digital album to which a method of thepresent invention is applied.

FIG. 7a is a screen capture showing one embodiment of GUI in which auser transmits a photo to a server in an internet album according to thepresent invention. FIG. 7b is a screen capture showing one embodiment ofGUI showing completed album list in an internet album according to thepresent invention. FIG. 7c is a screen capture showing one embodiment ofGUI of an internet album according to the present invention. FIG. 7d isa screen capture showing one embodiment of zoomed-in GUI in an internetalbum according to the present invention.

High quality image transmitted from database of the server can bedisplayed by various methods.

High quality image data are transmitted with only regions displayed on ascreen by a user's request. That is, if a user moves images by using amouse, only newly displayed region is transmitted from the database anddisplayed. Therefore, the user moves high quality digital image to anywanted directions. Also, if the user clicks a wanted part with a mouse,the part can automatically move to a center of a screen.

Image magnification or contraction function is performed by locating amouse cursor to a wanted part and clicking. The magnification orcontraction can be performed by a layer unit step by step, or can beperformed at one time from the highest step to the lowest step. At thistime, the new data are displayed by receiving data from the server. Incase of magnifying or contracting image, various effects can besimultaneously realized by using contents such as sound, image, text,and flash animation, etc.

In case that hyper-linked additional information exists at a specialposition of image, the corresponding information is displayed on ascreen real time. At this time, the additional information can bedisplayed on a current window, or on a new window. Additionalinformation data that will be used with high quality image includesmoving image file, sound file, flash animation, another high qualityimage file, text information, and web page address, etc.

The present invention has the following advantages. According to thereal time service of high quality multimedia digital gallery and themethod of the present invention, image data and additional datainteractive to one another are provided by one graphic user interface.As a result, a user can simultaneously obtain various informationeasily, can fast search wanted information on an image screen which isfast displayed, and can obtain the same resolution even if at the timeof magnifying the screen to search minute information. Therefore, a useris provided with individual images close to intuition and can usevarious additional information.

As the present invention may be embodied in several forms withoutdeparting from the spirit or essential characteristics thereof, itshould also be understood that the above-described embodiments are notlimited by any of the details of the foregoing description, unlessotherwise specified, but rather should be construed broadly within itsspirit and scope as defined in the appended claims, and therefore allchanges and modifications that fall within the metes and bounds of theclaims, or equivalence of such metes and bounds are therefore intendedto be embraced by the appended claims.

What is claimed is:
 1. A method of transferring at least one image to atleast two client systems, comprising: dividing an image into a pluralityof sub cells, each sub-cell comprising a portion of the image; receivinga first request from a first client system for a first prescribed numberof sub-cells; receiving a second request from a second client system fora second prescribed number of sub-cells; intellectual queuing ofsub-cells upon overlap of sub-cells requested by the first and secondclient systems such that the number of sub-cells queued is less than atotal of the first and second prescribed number of cells by a number ofoverlapped sub-cells; sending the first prescribed number of sub-cellsfrom the queued sub-cells to the first client system; and sending thesecond prescribed number of sub-cells from the queued sub-cells to thesecond client system, wherein a first image based on the firstprescribed number of sub-cells is displayed on the first client system,and the first additional sub-cells are stored on the first clientsystem, and wherein a second image based on the second prescribed numberof sub-cells is displayed on the second client, system and the secondadditional sub-cells are stored on the second client system.
 2. Themethod of claim 1, further comprising pipelining the first and secondrequests.
 3. The method of claim 1, wherein the image comprises one oforiginal image or an additional layer of the original image, which hasbeen magnified or reduced in image size.